Multibaseline Stereo in the Presence of Specular Reflections
نویسندگان
چکیده
We address the problem of accurate depth estimation using multibaseline stereo in the presence of specular reflections. Specular reflections can cause the intensity and color of corresponding points to change dramatically according to different viewpoints, thus producing severe matching errors for various stereo algorithms. In this paper, we propose a new method to deal with this problem by treating specular reflections as occlusions. Our idea is to first detect specular pixels by computing the uncertainty of depth estimates. Then we combine the use of flexible windows and an adaptively selected subset of images to avoid these specular areas in all the multibaseline stereo images. Even though specularities may exist in the reference image, accurate depth is nevertheless estimated for all pixels. Experiments show that our consideration of specular reflections leads to improved stereo results.
منابع مشابه
Diffuse-Specular Separation and Depth Recovery from Image Sequences
Specular reflections present difficulties for many areas of computer vision such as stereo and segmentation. To separate specular and diffuse reflection components, previous approaches generally require accurate segmentation, regionally uniform reflectance or structured lighting. To overcome these limiting assumptions, we propose a method based on color analysis and multibaseline stereo that si...
متن کاملComputation of stereo disparity for space materials
One of the challenges facing computer vision systems used in space is the presence of specular surfaces. Such surfaces lead to several adverse effects when imaged by vision systems such as the creation of reflected “virtual” images of objects due to specular reflections, specular reflection of light from the sun and other sources, and total reflection of any projected illuminants including lase...
متن کاملVariational Multiframe Stereo in the Presence of Specular Reflections
We consider the problem of estimating the surface of an object from a calibrated set of views under the assumption that the reflectance of the object is non-Lambertian. In particular, we consider the case when the object presents sharp specular reflections. We pose the problem within a variational framework and use fast numerical techniques to approach the local minimum of a regularized cost fu...
متن کاملKey characteristics of specular stereo.
Because specular reflection is view-dependent, shiny surfaces behave radically differently from matte, textured surfaces when viewed with two eyes. As a result, specular reflections pose substantial problems for binocular stereopsis. Here we use a combination of computer graphics and geometrical analysis to characterize the key respects in which specular stereo differs from standard stereo, to ...
متن کاملDetection of Small Obstacles at Long Range Using Multibaseline Stereo
This paper presents a multibaseline stereo technique specially suited to detecting obstacles. First, we describe traditional multibaseline stereo and explain why it is not suitable for obstacle detection. This analysis leads directly to a suitable method. Then we describe the obstacle detection system that we have built. Finally, we show results from our system for a variety of different obstac...
متن کامل